Volyn Oblast
Russian drone and missile attack on Ukraine kills one, wounds 15
At least one person has been killed and 18 others wounded in a Russian drone and missile attack on Ukraine, officials said, as Moscow launched its largest attack on its neighbour in weeks amid an ongoing diplomatic push for a ceasefire. Russian forces launched 574 drones and 40 missiles overnight, Ukraine's Air Force said on Thursday, adding that its air defence units had downed most of the attacks. But a number of the attacks struck targets in several locations across Ukraine, resulting in casualties and damage to buildings. In the western city of Lviv, about 70km (43 miles) from the border with Poland, a drone and missile attack killed one person, injured three and damaged 26 residential buildings, Governor Maksym Kozytskyi said. In Mukachevo, near the border with Hungary and Slovakia, 15 people were wounded in Russian attacks, local authorities said.
NATO jets scrambled amid Russia's largest drone attack on Ukraine
President Donald Trump says the U.S. will have to send more weapons to Ukraine, just days after Pentagon paused critical weapons deliveries to Kyiv. NATO jets were scrambled overnight as Russia carried out its largest drone attack yet on Ukraine, launching more than 700 drones, officials said. Ukrainian President Volodymyr Zelenskyy said the "new massive Russian attack on our cities" involved "728 drones of various types, including over 300 Shaheds, and 13 missiles – Kinzhals and Iskanders. "Most of the targets were shot down. Our interceptor drones were used -- dozens of enemy targets were downed, and we are scaling up this technology.
At least 3 killed in Russia's 'most powerful' attack on Ukraine's Kharkiv
At least five people have been killed and more than 20 wounded as Russia launched a barrage of missiles, drones and bombs across Ukraine, officials said. The Ukrainian air force said on Saturday that Russia struck with 215 missiles and drones overnight, and Ukrainian air defences shot down and neutralised 87 drones and seven missiles. At least three people were killed and 17 others, including two children, were wounded in the northeastern city of Kharkiv, Mayor Ihor Terekhov said, describing the assault as "the most powerful" on the city since Russia launched its full-scale invasion of Ukraine in 2022. He reported 48 Iranian-made drones, two missiles and four guided bombs were fired before dawn at the city of 1.4 million people, located just 50km (30 miles) from the Russian border. "Drones are still circling above," Terekhov wrote on Telegram at 4:40am (01:40 GMT), as air raid sirens wailed across the city. Residential buildings and civilian infrastructure were heavily damaged.
Retrospective: A CORDIC Based Configurable Activation Function for NN Applications
Kokane, Omkar, Raut, Gopal, Ullah, Salim, Lokhande, Mukul, Teman, Adam, Kumar, Akash, Vishvakarma, Santosh Kumar
A CORDIC-based configuration for the design of Activation Functions (AF) was previously suggested to accelerate ASIC hardware design for resource-constrained systems by providing functional reconfigurability. Since its introduction, this new approach for neural network acceleration has gained widespread popularity, influencing numerous designs for activation functions in both academic and commercial AI processors. In this retrospective analysis, we explore the foundational aspects of this initiative, summarize key developments over recent years, and introduce the DA-VINCI AF tailored for the evolving needs of AI applications. This new generation of dynamically configurable and precision-adjustable activation function cores promise greater adaptability for a range of activation functions in AI workloads, including Swish, SoftMax, SeLU, and GeLU, utilizing the Shift-and-Add CORDIC technique. The previously presented design has been optimized for MAC, Sigmoid, and Tanh functionalities and incorporated into ReLU AFs, culminating in an accumulative NEURIC compute unit. These enhancements position NEURIC as a fundamental component in the resource-efficient vector engine for the realization of AI accelerators that focus on DNNs, RNNs/LSTMs, and Transformers, achieving a quality of results (QoR) of 98.5%.
Fast Jet Tagging with MLP-Mixers on FPGAs
Sun, Chang, Ngadiuba, Jennifer, Pierini, Maurizio, Spiropulu, Maria
We explore the innovative use of MLP-Mixer models for real-time jet tagging and establish their feasibility on resource-constrained hardware like FPGAs. MLP-Mixers excel in processing sequences of jet constituents, achieving state-of-the-art performance on datasets mimicking Large Hadron Collider conditions. By using advanced optimization techniques such as High-Granularity Quantization and Distributed Arithmetic, we achieve unprecedented efficiency. These models match or surpass the accuracy of previous architectures, reduce hardware resource usage by up to 97%, double the throughput, and half the latency. Additionally, non-permutation-invariant architectures enable smart feature prioritization and efficient FPGA deployment, setting a new benchmark for machine learning in real-time data processing at particle colliders.
LUT-DLA: Lookup Table as Efficient Extreme Low-Bit Deep Learning Accelerator
Li, Guoyu, Ye, Shengyu, Chen, Chunyun, Wang, Yang, Yang, Fan, Cao, Ting, Liu, Cheng, Sabry, Mohamed M., Yang, Mao
The emergence of neural network capabilities invariably leads to a significant surge in computational demands due to expanding model sizes and increased computational complexity. To reduce model size and lower inference costs, recent research has focused on simplifying models and designing hardware accelerators using low-bit quantization. However, due to numerical representation limits, scalar quantization cannot reduce bit width lower than 1-bit, diminishing its benefits. To break through these limitations, we introduce LUT-DLA, a Look-Up Table (LUT) Deep Learning Accelerator Framework that utilizes vector quantization to convert neural network models into LUTs, achieving extreme low-bit quantization. The LUT-DLA framework facilitates efficient and cost-effective hardware accelerator designs and supports the LUTBoost algorithm, which helps to transform various DNN models into LUT-based models via multistage training, drastically cutting both computational and hardware overhead. Additionally, through co-design space exploration, LUT-DLA assesses the impact of various model and hardware parameters to fine-tune hardware configurations for different application scenarios, optimizing performance and efficiency. Our comprehensive experiments show that LUT-DLA achieves improvements in power efficiency and area efficiency with gains of $1.4$~$7.0\times$ and $1.5$~$146.1\times$, respectively, while maintaining only a modest accuracy drop. For CNNs, accuracy decreases by $0.1\%$~$3.1\%$ using the $L_2$ distance similarity, $0.1\%$~$3.4\%$ with the $L_1$ distance similarity, and $0.1\%$~$3.8\%$ when employing the Chebyshev distance similarity. For transformer-based models, the accuracy drop ranges from $1.4\%$ to $3.0\%$.
Putin mulls striking Kyiv with new hypersonic missile that can reportedly reach US West Coast
Veteran and former intel officer Don Bramer joined Fox & Friends First to discuss his reaction to Trump tapping Keith Kellogg to be his Ukraine-Russia envoy and the Biden admin working with the Trump team on peace in the Middle East. Following an overnight missile and drone attack by Russia targeting Ukraine's key energy infrastructure, Russian President Vladimir Putin now says that government buildings in Kyiv could be targeted next using a new hypersonic missile that could also potentially reach the U.S. Russian attacks have not so far struck "decision-making centers" in the Ukrainian capital as Kyiv is heavily protected by air defenses. But Putin says Russia's Oreshnik hypersonic missile, which it fired for the first time at a Ukrainian city last week, is incapable of being intercepted. Russia fired the Oreshnik at the Ukrainian city of Dnipro on Nov. 21, striking a weapons production plant. This was in retaliation against Ukrainian strikes on a Russian military facility in Bryansk two days earlier with U.S. made long-range missiles called ATACMS, after President Biden had given Ukrainian President Volodymyr Zelenskyy permission to do so.
Table-LLM-Specialist: Language Model Specialists for Tables using Iterative Generator-Validator Fine-tuning
Xing, Junjie, He, Yeye, Zhou, Mengyu, Dong, Haoyu, Han, Shi, Zhang, Dongmei, Chaudhuri, Surajit
In this work, we propose Table-LLM-Specialist, or Table-Specialist for short, as a new self-trained fine-tuning paradigm specifically designed for table tasks. Our insight is that for each table task, there often exist two dual versions of the same task, one generative and one classification in nature. Leveraging their duality, we propose a Generator-Validator paradigm, to iteratively generate-then-validate training data from language-models, to fine-tune stronger \sys models that can specialize in a given task, without requiring manually-labeled data. Our extensive evaluations suggest that our Table-Specialist has (1) \textit{strong performance} on diverse table tasks over vanilla language-models -- for example, Table-Specialist fine-tuned on GPT-3.5 not only outperforms vanilla GPT-3.5, but can often match or surpass GPT-4 level quality, (2) \textit{lower cost} to deploy, because when Table-Specialist fine-tuned on GPT-3.5 achieve GPT-4 level quality, it becomes possible to deploy smaller models with lower latency and inference cost, with comparable quality, and (3) \textit{better generalizability} when evaluated across multiple benchmarks, since \sys is fine-tuned on a broad range of training data systematically generated from diverse real tables. Our code and data will be available at https://github.com/microsoft/Table-LLM-Specialist.